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Movements of the upper limb are controlled mostly through the 
contralateral hemisphere. Although overall activity changes in the 
ipsilateral motor cortex have been reported, their functional signifi- 
cance remains unclear. Using human functional imaging, we ana- 
lyzed neural finger representations by studying differences in fine- 
grained activation patterns for single isometric finger presses. We 
demonstrate that cortical motor areas encode ipsilateral movements 
in 2 fundamentally different ways. During unimanual ipsilateral finger 
presses, primary sensory and motor cortices show, underneath 
global suppression, finger-specific activity patterns that are nearly 
identical to those elicited by contralateral mirror-symmetric action. 
This component vanishes when both motor cortices are functionally 
engaged during bimanual actions. We suggest that the ipsilateral rep- 
resentation present during unimanual presses arises because other- 
wise functionally idle circuits are driven by input from the opposite 
hemisphere. A second type of representation becomes evident in 
caudal premotor and anterior parietal cortices during bimanual 
actions. In these regions, ipsilateral actions are represented as non- 
linear modulation of activity patterns related to contralateral actions, 
an encoding scheme that may provide the neural substrate for coor- 
dinating bimanual movements. We conclude that ipsilateral cortical 
representations change their informational content and functional 
role, depending on the behavioral context. 

Keywords: cortical representation, fMRI, motor cortex, multivoxel pattern 
analysis 



Introduction 

Finger movements appear to be (almost) exclusively con- 
trolled by cortical areas in the contralateral hemisphere — if 
control is defined as a direct connection to the spinal cord 
(Brinkman and Kuypers 1973; Soteropoulos et al. 2011). 
However, many cortical motor areas also show overall activity 
increases or decreases in relation to finger movements of the 
ipsilateral hand (Kim et al. 1994; Cramer et al. 1999; Hanakawa 
et al. 2005; Verstynen et al. 2005; Talelli, Waddingham et al. 
2008; Horenstein et al. 2009)- The functional role of these ipsi- 
lateral cortical changes remains unclear. An important first step 
in answering this question is to determine whether and how 
characteristics of ipsilateral actions are encoded in cortical cir- 
cuits. This is based on the premise that a region that is involved 
in the control of movement, possibly through modulation of 
the other hemisphere, should contain neurons that are differen- 
tially active with respect to the relevant control variable. In 
other words, a region should contain a representation for 
the task control variable as a necessary (if not sufficient) con- 
dition for a region to play a functional role in control of this 
variable. For example, neurons in the hand area of the primary 
motor cortex show a differential tuning for different finger 



movements of the contralateral hand. Even though individual 
neurons respond to presses of multiple fingers (Schieber 2002; 
Acharya et al. 2008), and activation patches for individuated 
fingers overlap greatly (Indovina and Sanes 2001; Wiestler et al. 
2011), the neuronal population as a whole encodes the exact 
action very precisely. In contrast, an area that shows exactly the 
same neuronal firing pattern regardless of the digit involved 
cannot play either a direct (cortico-spinal projections) or indir- 
ect (cortico-cortical modulation) role in "control" of individu- 
ated finger movements, but can at best have a supportive 
function, such as sustaining attention to the task or controlling 
postural muscles in a finger-invariant manner. Although the 
primary motor cortex appears to represent the movement direc- 
tion of the ipsilateral arm (Donchin et al. 1998; Ganguly et al. 
2009), there is currently no evidence for an analogous ipsilat- 
eral representation of individuated finger movements. 

Using high-resolution functional magnetic resonance 
imaging (fMRI) and a statistical approach that tests for rep- 
resentation rather than average activation, we characterized 
how cortical motor areas represent ipsilateral isometric finger 
presses. If neurons are activated differentially for each finger, 
and if neuronal populations with similar properties are suffi- 
ciently clustered together, then we should be able to decode 
individual fingers from local fMRI activity patterns. Using this 
decoding approach, called multivoxel pattern analysis (MVPA, 
Kriegeskorte et al. 2006), we have recently found finger rep- 
resentations in the primary motor cortex and the cerebellum. 
It is noteworthy that this method, unlike a center-of-gravity 
(COG) analysis of individual fingers (Indovina and Sanes 
2001), does not require any systematic somatotopy. Indeed, 
using this method, we were able to show finger represen- 
tations in the inferior cerebellum, which lack any discernable 
somatotopic organization for individual fingers (Wiestler et al. 
2011). 

The experiments reported here show that there are 2 fun- 
damentally different types of representation of ipsilateral 
fingers. During unimanual presses (Experiment 1), we find 
that the activity patterns elicited by each ipsilateral finger are 
highly correlated with those for the corresponding contralat- 
eral finger. Furthermore, these mirrored activation patterns 
disappear during bimanual finger presses (Experiment 2). 
Therefore, we conclude that ipsilateral representations during 
unimanual actions rely on the activation of the very same 
neuronal circuits that control the mirror-symmetric contralat- 
eral action. That is, if the 2 representations were at least par- 
tially independent, the region would have been able to 
represent both the ipsi- and contralateral actions simul- 
taneously. A second type of ipsilateral representation 
becomes visible during bimanual actions. Here, both a 
premotor region and a parietal region encode unique 
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combinations of contra- and ipsilateral fingers. This type 
of representation is ideally suited to learning and controlling 
coordinated bimanual actions. 

Materials and Methods 

Participants 

We tested 6 participants in Experiment 1 (unimanual left and right 
finger presses) and 7 in Experiment 2 (unimanual and bimanual 
presses). Four participants took part in both experiments, with at 
least 1 week separating the 2 experimental sessions. All participants 
were right-handed with an average laterality score (Oldfield 1971) of 
0.88 (SD = 0.13), with 1 indicating the strongest right-hand preference 
and —1 the strongest left-hand preference. The average age was 25.9 
years (SD = 51), and the sample included 6 men and 3 women. All 
experimental procedures were approved by the Ethics Committee of 
University College London. 

Apparatus and Stimuli 

Participants placed all 10 fingers on a keyboard, which was secured 
with a foam pillow on the participant's lap. The keyboard had 10 
elongated keys, 20 mm wide, with a groove for each fingertip. A force 
transducer was mounted below each key and measured the force 
exerted by the finger. The force transducers (Honeywell FS series) 
had a dynamic range up to 16 N, with a repeatability of constant force 
measurements of <0.02 N. Signals from the force transducers were 
transmitted from the scanner room via a shielded cable. Filters in the 
scanner room wall prevented leakage of radiofrequency noise. 

Participants executed isometric finger presses against the nonmo- 
vable keys. This setup allowed for very tight control of the behavior, 
while simultaneously monitoring for possible mirror movements. 
While isometric presses are technically not overt movements, they 
involve voluntary activation of specific muscles and produce sensory 
feedback commonly associated with full hand movements. Nonethe- 
less, we refer to these actions as finger presses, to acknowledge the 
possibility that our results may not fully generalize to free finger 
movements. 

Participants viewed a projection screen mounted behind the 
scanner bore via a mirror. The screen showed a central cross, on 
which participants were instructed to fixate during the entire 
experiment. 

Image Acquisition 

Data were acquired on a 3 T Siemens Trio system with a 32-channel 
head coil. Functional data comprised 8 runs of 126 volumes each, 
using a 2D echo-planar imaging sequence [repetition time (TR) = 2.72 s]. 
The first 3 volumes were discarded to allow magnetization to reach 
equilibrium. We acquired 32 slices in an interleaved sequence at a 
thickness of 2.15 mm (0.15 mm gap) and an in-plane resolution of 
2.3x2.3 mm . The matrix size was 96x96. The slices covered the 
dorsal aspects of the cerebrum. The cerebellum and the inferior 
aspects of the occipital and temporal lobes were not covered. Field 
maps were obtained after the first functional run to correct for inho- 
mogeneities in the main magnetic field (Hutton et al. 2002). We also 
acquired a single Tl-weighted anatomical scan (3D magnetization- 
prepared rapid gradient echo sequence, 1 mm isotropic, 240 x 256 x 
176 mm field of view). 



Procedure 

To determine whether activity patterns observed during ipsilateral 
presses were finger-specific, we used a slow event-related design. On 
every trial (3 TRs = 8. 16 s), participants made 5 paced isometric 
presses with the same finger. Each trial consisted of 6 short events, 
each 1.36s long. The first event was the display of the instructional 
cue. The outline of the keyboard was presented, with each key shown 
in gray. The keys to be pressed were highlighted in green. After this 
event, the instructional cue was removed and instead of the fixation 



cross, the letter "P" was presented in white, signaling participants to 
make a short isometric force press with the instructed finger(s). When 
a finger press exceeded 2.3 N, a response was registered and the 
letter turned blue. If the participant accidentally pressed the wrong 
finger, the letter turned red. After 1.36 s, the letter turned white 
again, signaling the next finger press. After 5 finger presses, the trial 
ended. In most cases, the next trial began immediately afterwards 
with the display of the next instructional cue. In each run, we also 
randomly inserted 5 rest phases between trials, which lasted either 5 
or 6 TRs. 

Experiment 1 tested how the representation of ipsilateral finger 
movements relates to the representation of contralateral finger move- 
ments. Each of the 10 fingers was probed 3 times per run, resulting in 
30 trials. The sequence of the fingers was fully randomized. Exper- 
iment 2 addressed the question of how representations of contra- and 
ipsilateral fingers interact during bimanual movements. To obtain 
enough data for each of the fingers, we studied only 3 of the fingers 
from each hand (digits 1, 3, and 5). Trials required either a single 
finger press on the left or right hand (unimanual) or a finger press on 
each hand (bimanual). All possible finger combinations were used, 
resulting in 6 unimanual and 9 bimanual trial types. Each trial type 
was repeated twice per run, yielding 30 trials per run. 

First-Level Analysis 

The functional data were analyzed using SPM8 (Friston et al. 1999) 
and custom-written Matlab code. First, we corrected for slice- 
acquisition timing by shifting the acquisition to align with the middle 
slice of each volume. We then corrected for head movements using a 
6-parameter motion correction algorithm. This step also included cor- 
rection of possible image distortions using the acquired fieldmap data 
(Andersson et al. 2001; Hutton et al. 2002). The realigned functional 
data were then coregistered to the anatomical scan, using the auto- 
matic algorithm in SPM. The coregistration was visually checked, and 
the affine parameters were adjusted by hand to improve the alignment 
in the region of the central sulcus, if necessary. 

The preprocessed data were analyzed using a general linear model. 
To remove the influence of movement-related artifacts, we used a 
weighted least-squares approach (Diedrichsen and Shadmehr 2005). 
For each trial type (10 in Experiment 1 and 15 in Experiment 2), we 
defined 1 regressor per imaging run. The regressor was a boxcar 
function that started at the moment of the first finger press and lasted 
for 8 s. This function was convolved with the standard hemodynamic 
response function. Preliminary analyses showed that this function 
provided a very good fit to the movement-evoked response in the 
hand area of the primary motor cortex. The analysis resulted in 8 acti- 
vation estimates (beta-images) for each trial type, 1 per run. 

Surface-Based Analysis and Searchlight Approach 

From the anatomical images, we obtained a surface reconstruction 
using the software Freesurfer (Dale et al. 1999), which estimates the 
outer boundary of the gray matter (pial surface) and the white-gray 
matter boundary (white surface). The surfaces were aligned via 
spherical registration to the Freesurfer average atlas (fsaverage, Fischl 
et al. 1999). Individual data were then projected onto the group map 
via the individual surface. Correction for multiple tests was performed 
on the surface using Gaussian field theory (Worsley et al. 1996). 

To detect finger-specific representations anywhere in the cortex, 
we used a surface-based searchlight approach (Fig. 1 ; Oosterhof et al. 
2011). We defined a circular region on the cortical surface and se- 
lected all voxels that lay, even partly, between the pial and white sur- 
faces. For Experiment 1, we chose the radius such that 80 voxels were 
included. In Experiment 2, we required higher sensitivity to detect 
the relatively weak encoding for bimanual actions and therefore in- 
cluded 160 voxels. This resulted in an average searchlight radius of 
6.9 or 9-8 mm, respectively. In comparison to standard volume-based 
searchlights (Kriegeskorte et al. 2006), a surface-based searchlight 
minimizes the bleeding of information from one region to the other 
across a sulcus and therefore allows for regionally specific inferences 
(Chen et al. 2011; Oosterhof et al. 2011). The activation estimates 
(beta-images) from the first-level analysis of the selected voxels were 
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Figure 1. Multivariate analysis methods. On the reconstructed cortical surface, a circular area (searchlight) was selected. The activation values for all corresponding voxels 
(activation patterns) were extracted for all trials. A cross-validated classification approach was used for each hand separately to determine whether activation patterns contained 
information about the finger pressed. In areas with information about both contra- and ipsilateral fingers, we used a similarity analysis (Fig. 3) to determine the relationship 
between representation of contra- and ipsilateral fingers. 



then submitted to a classification analysis (discussed subsequently), 
and the resulting classification accuracy was assigned to the center of 
the sphere. By moving this "searchlight" continuously over the corti- 
cal surface, we constructed a map describing how well the local voxel 
pattern represented the action of the contra- or ipsilateral finger. 

Classification 

If a region represents individuated finger movements, then local 
activity patterns should differ systematically for presses of different 
fingers. To test for such finger-specific activity patterns, we used a 
classification approach. A linear multiclass classifier was trained on 
data from 7 of the 8 imaging runs and then tested by classifying the 
finger presses on the 8th run (Pereira et al. 2009). By retraining and 
classifying over all possible test- and training-sets, we determined the 
average cross-validated accuracy for each set of voxels. The size of the 
classification accuracy can be taken as a measure of how strongly 
the activity patterns in this patch of cortex are modulated in a consist- 
ent finger-specific fashion. 

As an input to the classifier, we used the activation estimates 
(beta-images) from the first-level analysis for P voxels. The classifier 
assumes that each pattern y t (Pxl vector) comes from a multivariate 
normal distribution, with a condition-specific mean fx, c (Pxl vector) 
and a common PxP voxel-covariance matrix %. The conditions c relate 
here to the 5 fingers of a hand (unimanual classifier, Experiment 1) 
or to the 9 unique bimanual combinations (bimanual classifier, 
Experiment 2). The maximum-likelihood estimates for /j. c and 2 were 
derived from the training data. Because we had more voxels than 
trials, 2 was ill-conditioned, so we regularized the covariance estimate 
by adding a small constant (1% of the mean of the diagonal elements) 
to the diagonal (Pereira et al. 2009). We classified the pattern vectors 
y from the remaining run by calculating the discriminant function for 
each class c: 

gdy) = ^~ x y - 2^I s ~Vc (!) 

This term is (up to a constant) the log-likelihood that the pattern y 
belongs to class c. The pattern was assigned to the class with the 
highest likelihood. 

For Experiment 1 (unimanual presses only), we used 1 classifier to 
distinguish between the 5 fingers of the left hand and 1 classifier to 
distinguish between the 5 fingers of the right hand. Each classifier 
had a guessing baseline of 20%. For Experiment 2 (unimanual + 
bimanual presses), we used 3 separate classifiers, 1 for each uniman- 
ual condition and 1 for the bimanual condition. For the bimanual con- 
dition, we trained the classifier to distinguish between the 9 different 
trial types arising from the different finger combinations. That is, the 
classifier treated all categories independently, even though some com- 
binations may have shared a finger. This ensured that the classifier 
could detect any form of bimanual encoding without any prior as- 
sumptions about the structure of the representation. For example, the 
classifier did not assume that patterns containing the same 



contralateral or ipsilateral finger were more similar to each other than 
patterns that did not. 

From the predicted category, we could then calculate the classifi- 
cation accuracy for the ipsi- and contralateral fingers independently. 
For example, if the true action involved pressing both middle fingers, 
and the pattern was classified as involving contralateral middle and 
ipsilateral index finger press, then the contralateral finger would have 
been classified correctly and the ipsilateral finger incorrectly. Gues- 
sing baseline for all classification decisions in Experiment 2 was there- 
fore 33%. For group analysis, the classification accuracies were 
transformed to ^-scores, assuming a binomial distribution of the 
number of correct guesses. We then tested these ^-scores against zero 
(guessing level) across participants. 

Regions of Interests (ROIs) 

To study the characteristics of the digit representations, we used both 
an anatomical and functional ROI approach. We defined the anatomical 
ROIs based on the probabilistic cytoarchitectonic maps aligned to the 
average Freesurfer surface (Fischl et al. 2008). The ROI for Ml com- 
prised all of Brodmann area 4 (both rostral and caudal), and the ROI 
for SI contained Brodmann areas 3a, 3b, 1, and 2. Brodmann area 6 
was split into a lateral aspect [premotor cortex (PM)] and a medial 
aspect [supplementary motor area (SMA)/preSMA]. The superior parie- 
tal lobule (SPL) ROI included Brodmann area 7 (7A, IP, and 7M) and 
medial intraparietal sulcus (IPS) (Scheperjans et al. 2008). The surface- 
based ROIs were projected into the volume using the individual sur- 
faces. All voxels that touched one of the selected nodes on the white or 
pial surface were included in the ROI. To minimize the mixing of func- 
tional imaging signals across sulci, we excluded all voxels assigned to 
multiple ROIs from further analysis (e.g. voxels in the middle of the 
central sulcus). For some analyses, we combined Ml and PM to a pre- 
central ROI and SI and SPL to a postcentral ROI. 

We also defined 2 different types of functional ROIs within the 
anatomical ROI by selecting subsets of voxels with different func- 
tional properties on an individual-subject level. We defined the "func- 
tional finger ROI" as the region that best represented individual finger 
presses. To determine this region, we ran a volume-based searchlight 
on the set of voxels in each ROI. We again adjusted the radius of the 
searchlight for each center, such that either 80 (Experiment 1) or 160 
voxels (Experiment 2) were included. We then selected the search- 
light centers that were associated with the highest classification accu- 
racy in each participant. For the selection of functional ROIs in 
Experiment 1, we averaged the accuracy of the ipsilateral and contral- 
ateral fingers for each voxel and then selected the voxels with the 
highest accuracy (top 20%, chosen because the hand region is 
roughly one-fifth of the surface of primary motor cortex) within each 
region. For the selection of functional ROIs in Experiment 2, we used 
the same approach, this time averaging the accuracies for the contra- 
and ipsilateral fingers during unimanual and bimanual presses and 
selecting the top 20% of voxels on these combined scores. Finally, we 
also defined a "functional bimanual ROI" by selecting the voxels with 
the 20% highest classification accuracies for the ipsilateral finger 
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during bimanual actions. Because these areas lay mainly on the 
boundary between primary and secondary motor areas, we used this 
method on a pre- and postcentral anatomical ROI. 

Note that we did not use the ROI approach to make judgments of 
"whether" any regions significantly encoded finger presses in the first 
place. These tests were performed using multiple comparison correc- 
tions for the whole cortical surface. The functional ROI selection pro- 
cedure was then performed to analyze "how" these regions encoded 
the finger presses. For example, we could compare within these ROIs 
between contra- and ipsilateral conditions for Experiment 1 and 
between contralateral, ipsilateral, unimanual, and bimanual con- 
ditions for Experiment 2. This is assured because these contrasts are 
orthogonal to the voxel-selection criterion, and the experimental 
design was fully balanced (Kriegeskorte et al. 2009). Also, any assess- 
ment of the correlation between left- and right-hand patterns can be 
made in an unbiased fashion, as the classification is performed inde- 
pendently for the 2 hands and selection is not biased toward specific 
patterns. For the decomposition analysis presented in Figure 7, we 
ensured through Monte-Carlo simulation that the selection criterion 
did not bias subsequent analyses. 



COG Analysis 

To determine whether there were significant differences in the 
location of the representations for ipsi- versus contralateral fingers, 
we determined the COG of the area with above-chance classification 
accuracy within the precentral and postcentral anatomical ROIs. Note 
that this approach differs from calculating the COG of the activation 
elicited by each finger (Indovina and Sanes 2001), a procedure that 
can test for a systematic somatotopic organization. Here, we ask 
whether the overall representation of ipsi- and contralateral finger 
presses was located in the same or different regions. The analysis was 
conducted on a flattened representation of the group surface. For 
each individual, we calculated the average spatial coordinates (.x,y) 
for all vertices with above-chance accuracy C^-score >0), with each 
vertex weighed by the size of the ^-score. Differences between center 
locations for ipsi- and contralateral accuracies were then tested across 
participants using a Hotelling's T2-test. 

Pattern Component Analysis 

Experiment 1. To assess the similarity of ipsilateral and 
contralateral finger patterns, we split each response pattern into an 
informative component (i.e. finger-related) and into a number of 
uninformative components (common activation patterns or noise). 
The correlation between patterns was then calculated on the 
informative part only. This method (Diedrichsen et al. 2011) allows 
the assessment of pattern similarity, while accounting for the 
influence of possible common activation patterns (which would 
increase correlations) and random trial-by-trial noise (which would 
decrease correlations). Using this technique, each observed pattern 
vector yij „ (fth hand, jth finger, and rath run) was decomposed into a 
common component for the hand h,, finger fj, and run r n and a noise 
component Ey*. We estimated the variances of the left- and 
right-hand patterns and the covariance between them, as well as the 
variances of the finger patterns for each hand (tr?) plus the average 
covariance between the 5 matching finger pairs (y). Additionally, we 
estimated the variability of the component common to each run and 
of the trial-by-trial noise. The correlation between the ipsi- and 
contralateral finger patterns was calculated as: 



pattern for they'th finger of the left hand {bij), the pattern for the kth 
finger of the right hand (b 2i k), and an interaction term for the unique 
bimanual combination (/,,*). Additionally, as effects of no interest, we 
allowed for a common bimanual activation pattern (#3), a pattern 
common to all trials with a run (r„) and a noise term (83**,,,). As 
mentioned earlier, we modeled the activity patterns in the unimanual 
condition (y/j>) as the sum of an activation pattern common to all 
fingers of the fth hand (ft,), a jth finger-specific pattern for that hand 
(fij), a run-specific pattern (r„), and a noise term for that trial. We 
estimated the variance of all of these components. We also estimated 
the covariance between the unimanual finger-specific patterns (f) and 
the corresponding bimanual finger-specific patterns (fo). Of primary 
interest, however, was the size of the interaction term (0 and the 
main effect for the ipsilateral and contralateral fingers (6 X , fo 2 ). 

Removal of Mirror Movements from the Contralateral Hand 

It is important to consider the alternative explanation that the ipsilat- 
eral finger representation was caused by subtle mirror movements of 
the contralateral hand, induced by uncrossed cortico-spinal projec- 
tions. Such movements might lead to sensory-evoked activity, which 
could in turn be used to indirectly decode the presses of the ipsilateral 
fingers. 

To monitor mirror movements, we instructed participants to exert 
light pressure with all fingers of both hands at all times on the 
response keys. Mirror contraction would then show up as subtle in- 
creases in the force produced by the matching fingers of the contral- 
ateral hand. Pilot experimentation indicated that this provided a more 
sensitive measure of mirror movements in the fMRI environment than 
electromyography. The force changes were then regressed out from 
the activity patterns, before submitting them to the classification 
analysis. If during ipsilateral actions the region only responded to the 
induced contralateral force changes, classification accuracy for the 
ipsilateral finger should be reduced to a guessing baseline. 

To obtain unbiased results, we applied this approach in a cross- 
validated fashion: on each iteration of the cross-validation approach, 
we regressed the training data (Y train ) against the forces produced in 
the ipsilateral (Z ipsi ) hand and the (possibly) induced mirror move- 
ments in the contralateral (Z contia ) hand. This regression was per- 
formed using the pattern component model, in which the variance of 
each component across voxels was estimated to regularize the esti- 
mation of the coefficients u (Diedrichsen et al. 2011): 



ytrain ytrain 
ipsi contra 



"ipsi 
^contra 



+ E. 



(3) 



The 5 estimated pattern components related to the mirror movements 
(u CO ntra) were then removed from the training and test data sets and 
the cleaned data submitted to the classification analysis: 



Ytrain* 
Ytest* 



Y 

: Y 1 



train "ytrain 

^contra^tmtra 

test <ytest 

'contra * 



(4) 



(2) 



Monte-Carlo studies showed that this method reduces the classification 
accuracy to chance level if the classification of the ipsilateral fingers is 
mediated fully through mirror movements in the contralateral hand. 

We conducted a similar analysis for the bimanual condition of 
Experiment 2 to test the possibility that the nonlinear encoding of bi- 
manual actions was caused by the fact that the presses of the contral- 
ateral hand were modulated in a nonlinear fashion by presses of the 
ipsilateral hand. Again, we regressed out the force changes in the con- 
tralateral hand from the activation patterns and then submitted the 
data to the classification analysis. 



Because these correlation estimates could become unstable if the 
variance associated with the finger patterns was very low, a very small 
constant (le— 5) was added to all finger variances. 

Experiment 2. The purpose of the pattern component analysis for 
Experiment 2 was to determine how the ipsi- and contralateral 
patterns combined during bimanual actions. Therefore, we modeled 
the bimanual patterns (yi,j,k,n, hand condition i = 3) as the sum of the 



Results 

Experiment 1: Unimanual Actions 

We first determined the changes in the overall blood- 
oxygenation level-dependent (BOLD) response during contra- 
and ipsilateral finger presses. Figure 2A shows activation aver- 
aged over all fingers of each hand compared with the rest. For 
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Figure 2. Representation of contra- and ipsilateral finger presses in the human neocortex. {A) Group-average percent signal change (threshold ±0.2%) averaged over all fingers 
and compared with rest. During ipsilateral actions, suppression can be observed in primary sensory and motor cortices. Positive activation during ipsilateral finger presses can be 
observed in the left hemisphere, (fl) Classification accuracy, thresholded at >32%, Z> 1.97. Colored regions show local voxel patterns that significantly distinguish between 
different fingers. High classification accuracy for ipsilateral presses can be found in regions that are deactivated compared with the rest. (C) Mean signal change and 
classification accuracy for contralateral (red) and ipsilateral (blue) finger presses in the informative region within 5 anatomically defined ROIs of the left (L) and right hemispheres 
(R). Error bars indicate across-subject SE. (fl) Overlap of classification accuracy (>32%) for contralateral (red) and ipsilateral (blue) fingers. Circles indicate the COG of 
classification accuracy for individual participants for precentral and postcentral ROIs. CS, central sulcus; SFS, superior frontal sulcus. 



contralateral finger presses, we found activation in a set of 
regions including the hand area of primary motor cortex 
(Ml), primary sensory cortex (SI), PM, the SMA, and SPL. 

Significant overall signal changes (corrected for multiple 
tests, Table 1) were also observed during ipsilateral presses. 
"Decreases" in overall activity were found in both hemi- 
spheres in the primary sensory and motor cortices. Significant 
signal "increases" were observed in ipsilateral PM (Cramer 
et al. 1999; Hanakawa et al. 2005; Verstynen et al. 2005; 
Horenstein et al. 2009; Verstynen and Ivry 2011) and SMA. 
Consistent with previous results (Kim et al. 1994; Verstynen 
et al. 2005), we found that these activity changes were asym- 
metric across hemispheres. Figure 2C shows the percent 
signal change in the functional finger area of the 5 anatomical 
ROIs (see Materials and Methods). Whereas the BOLD signal 
for contralateral presses (left or right) was similar in left and 



right hemispheres [all f(5)<1.59, P>0.17], the BOLD signal 
for ipsilateral presses was always higher in the left hemi- 
sphere. The difference between hemispheres did not reach 
significance in Ml [?(5) = 2.091, P=0.09\ or SI [f(5) = 2.091, 
P=0.09], but was significant for PM [f(5) = 3.531, P= 0.017], 
the SMA [f(5) = 5.924, P = 0.002], and SPL [f(5) = 3.426, 
P= 0.019]- In sum, these results replicate previous findings of 
systematic BOLD signal decrease in the primary hand area 
(Talelli, Ewas et al. 2008) and increases in slightly more 
anterior regions, especially in the left hemisphere (Kim et al. 
1993; Verstynen et al. 2005). 

Encoding of Contra- and Ipsilateral Fingers 
We then asked whether the activation changes related to 
ipsilateral finger presses reflect a nonspecific response or 
whether the neural activity encodes specific movement 
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Table 1 

Areas showing significant BOLD signal increases or decreases in Experiment 1 during ipsilateral 
finger presses 

Name Peak f-value Area (mm 2 | P (corn) x (mm) y (mm) z (mm) 



Ipsilateral movement > rest 



Left SMA 


8.75 


214 


0.001 


-5.79 


-2.12 


58.87 


Left PM 


12.5 


97 


0.023 


-41.42 


-4.09 


43.69 


Ipsilateral movement < rest 












Left M1/S1 


-18.59 


216 


0.001 


-33.53 


-23.80 


46.11 


Right SI 


-116.38 


274 


0.000 


46.64 


-17.69 


52.07 


Right M1 


-8.24 


86 


0.025 


27.29 


-21.99 


61.20 


Right M1 


-14.68 


87 


0.001 


44.30 


-9.39 


34.67 


Right SPL 


-14.77 


125 


0.035 


27.48 


-42.01 


53.02 



Note: Only clusters that are significantly corrected for multiple tests over the sensory motor 
areas (M1, S1, PM, SMA. and SPL) of the hemisphere are shown. At an uncorrected threshold 
of t(5) < -4.03, P = 0.005, the critical cluster size for P < 0.05, family-wise error-corrected, is 
75.4 mm 2 . The peak f-value, the size of the area in mm 2 , and the cluster-corrected P-value are 
listed, x-, y-, and z- coordinates are reported for the location of the local maxima on the average 
Freesurfer surface, which was aligned to the Montreal Neurological Institute atlas. 

parameters (i.e. the specific finger pressed). Multivoxel 
pattern analysis can detect such representations by testing for 
systematic differences in the local activity patterns for differ- 
ent task conditions. The strength of the method is that it can 
detect task-relevant representations, even if these do not have 
a systematic somatotopic organization, or fall below the 
spatial resolution of fMRI (Kamitani and Tong 2005, 2006; 
Swisher et al. 2010; Wiestler et al. 2011). Using a surface- 
based searchlight approach (Kriegeskorte et al. 2006; Oosterhof 
et al. 2011), we tested for the presence of ipsi- and contralateral 
finger representations anywhere on the cortical surface 
(Fig. 2E). 

As expected, contralateral finger representations were 
found in the hand area of Ml (Yousry et al. 1997) and in an 
extended region of SI, with average classification accuracies 
in the informative regions (see Materials and Methods for defi- 
nition) reaching 84% (Fig. 2C). Furthermore, the area of sig- 
nificant classification accuracy extended into the dorsal PM, 
the SPL, and the SMA. Thus, consistent with other results 
(Indovina and Sanes 2001; Maier et al. 2002; Wiestler et al. 
2011), we found evidence for representations of individuated 
finger movements in multiple contralateral cortical regions. 

Surprisingly, however, the same regions that had a rep- 
resentation of the contralateral finger also encoded finger 
presses of the ipsilateral hand. The average classification accu- 
racy in the functional finger area was 48% for Ml and 50% for 
SI. The representation of ipsilateral finger movements was 
clearly visible in each individual participant (Supplementary 
Fig. SI) and was significant after correcting for multiple tests 
across the cortical surface in all regions, including the SMA 
and parietal cortex (Table 2). It is noteworthy that the rep- 
resentation was "not" centered on regions that showed activity 
increases with ipsilateral finger presses. The strongest rep- 
resentation of ipsilateral fingers was found in regions in 
primary sensory and motor cortices, that showed negative or 
no "overall" signal change during ipsilateral actions compared 
with the rest. This indicates that there can be systematic and 
informative variations of the BOLD signal, even if the overall 
mean activity is below or close to zero (see also Wiestler et al. 
2011). In contrast, when we selected a functional ROI in PM 
that was defined by the voxels that showed the highest 
activity increases during ipsilateral presses, classification accu- 
racy was appreciably lower (28.4%, SD = 0.043%). 



Table 2 

Surface clusters that show significant classification accuracy for ipsilateral actions in Experiment 1 



Region 


Peak t-value 


Area (mm 2 ) 


P (cl.) 


x (mm) 


y (mm) 


z (mm) 


Left S1 


17.75 


1570 


0.000 


-45.44 


-26.44 


37.27 


Left M1 


21.16 


522 


0.001 


-35.68 


-11.42 


59.90 


Left SPL 


12.34 


433 


0.001 


-21.86 


-61.67 


57.73 


Right M1/S1 


25.62 


1741 


0.000 


29.55 


-28.61 


48.79 


Right SMA 


17.11 


429 


0.001 


8.69 


-11.39 


62.37 


Right SPL 


19.44 


408 


0.001 


23.03 


-58.07 


52.05 



Note: Only clusters that are significantly corrected for multiple tests over the cortical surface of 
the hemisphere are shown. At an uncorrected threshold of t(5) > 4.03, P = 0.005, the critical 
cluster size for P < 0.05, corrected, is 107 mm 2 . 



The areas that encoded ipsilateral finger presses also over- 
lapped nearly perfectly with the areas that encoded contralat- 
eral fingers (Fig. 2D). To test this observation quantitatively, 
we determined the COG (see Materials and Methods) of the 
above-chance classification accuracy for each participant for 
the precentral and postcentral anatomical ROIs. We then 
tested whether the COG locations were significantly different 
for ipsi- and contralateral presses. For the precentral ROI, we 
found no significant differences in either the right [7^(2,4) = 
12.20, 7"= 0.08] or left hemisphere [7^(2,4) = 3.292, 7> = 0.36]. 
For the postcentral ROI, there was a significant posterior shift 
in the ipsilateral compared with the contralateral represen- 
tation in both the left [ 7^(2,4) = 83.80, P = 0.003] and right 
hemispheres [7^(2,4) = 23.64, P= 0.03]. 

Thus, while a subtle spatial gradient could be observed in 
the postcentral ROI, our results indicated that contra- and ipsi- 
lateral finger presses were largely encoded in the same areas. 
The ipsilateral representation was centered on regions whose 
mean activity decreased overall during ipsilateral presses, 
rather than on the more anterior regions where mean activity 
increased. 

Similarity Analysis: Contra- and Ipsilateral Finger Maps 
are Highly Correlated 

Our spatial analysis shows that the representations of contra- 
and ipsilateral finger presses overlap greatly. This could occur 
in several ways: Figure 5A illustrates how a set of hypothetical 
finger patches, that is, groups of neurons that preferentially 
respond during presses of contra- and ipsilateral fingers, 
could be arranged in the hand area of 1 hemisphere. In one 
extreme, the ipsilateral patches are closely interdigitated with 
the contralateral patches in such a way that there is no 
relationship between the tuning for individual fingers (uncor- 
rected representations). In the other extreme, ipsilateral 
movements would activate the very same cortical patches that 
are involved in the control of the contralateral presses (identi- 
cal representations). In an intermediate scenario, contra- and 
ipsilateral finger patches are independent, but are arranged in 
a spatially correlated manner (correlated representation). The 
latter 2 arrangements would predict that we should find a 
high correlation between the activity patterns elicited by 
movements of contra- and ipsilateral fingers. 

To illustrate the relationship of the activation patterns 
graphically, we selected the functional finger ROI of Ml (see 
Materials and Methods) and split its voxels into 5 groups, de- 
pending on the contralateral finger for which they showed the 
highest activity (Fig. 37?, left). For example, we labeled all 
voxels that showed higher activity for the thumb compared 
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Figure 3. Similarity analysis between ipsilateral and contralateral finger 
representations. (4) Three hypothetical arrangements of finger patches: small regions 
of cortex that are preferentially activated for one of the contralateral (solid circles) or 
ipsilateral (dashed circles) fingers. Note that activation patches for individual fingers 
in M1 are highly overlapping; the distinct patches are for illustration only. 
Uncorrelated representations: patches for ipsi- and contralateral fingers are distinct 
and arranged in an interdigitated but uncorrelated fashion. Correlated representations: 
distinct patches, although patches responding to ipsilateral finger movements are 
always near patches responding to the corresponding contralateral fingers. Identical 
representations: ipsilateral movements activate the same patches as the 
corresponding contralateral finger. The latter 2 architectures would lead to a high 
spatial correlation of ipsilateral and contralateral patterns. (S) Percent signal change in 
the hand area of primary motor (averaged over hemispheres and individuals) for 
contra- and ipsilateral finger presses. Data are split into 5 groups of voxels according 
to the contralateral finger for which the voxels showed the maximal activation (left, 
highlighted diagonal in matrix). For ipsilateral actions (right), voxel groups tend to 
show the highest activation, below a global suppression, for movements of the 
mirror-symmetric ipsilateral finger. (C) Voxel-by-voxel correlation between the 
contralateral and ipsilateral finger patterns, corrected for overall noise and common 
activation patterns. The box plot extends from the 25th to the 75th percentile. 
Whiskers indicate the full range of the data. Outliers (indicated by circles) are data 
points that are more than 1 .5 times the box length away from the median. 

with all other fingers as "thumb voxels." We then analyzed 
the activity of these voxel groups for ipsilateral finger presses 
(Fig. 3B, right). Although all 5 voxel groups showed suppres- 
sion, most of the groups showed relatively higher activation 
for the same fingers during contra- and ipsilateral presses. For 
example, the thumb voxels (first row) had the highest activity 
during ipsilateral thumb presses, that is, suppression was 



lowest for this condition. Thus, below the general suppression 
of the BOLD signal in the ipsilateral motor cortex, we found 
an activity pattern similar to that observed during presses of 
the corresponding contralateral fingers. 

To quantify the correlation between the contra- and ipsilateral 
representation, we employed a new pattern-decomposition 
method (Diedrichsen et al. 2011). Using this method, we de- 
composed the contra- and ipsilateral activity patterns into a 
component that was informative about which of the 5 fingers 
moved and 2 noninformative components: a common non- 
specific component and noise. This allows us to calculate the 
correlation between the informative parts of the ipsi- and con- 
tralateral patterns, independent of noise levels or a common 
activation pattern shared by all contra- and ipsilateral acti- 
vations. The resultant correlation coefficients, therefore, indi- 
cate the degree to which finger-specific patterns for ipsilateral 
fingers are explained by the contralateral finger-specific rep- 
resentation. The mean correlation coefficient (Fig. 3C7) was 
0.83 (range 0.45-0.90) for Ml. Similarly, high correlations 
were found for SI (r= 0.77) and PM (r= 0.75), with lower cor- 
relations in SMA (r=0.57) and SPL (r=0.54). Notably, the 
premotor region that increased activity with ipsilateral move- 
ments (Verstynen et al. 2005; Verstynen and Ivry 2011) also 
showed a substantial correlation between contra- and ipsilat- 
eral activity patterns (r=0.60). Thus, the neural pattern that 
informed us about the ipsilateral finger was well predicted 
(70% for the primary motor cortex) by the activity patterns 
observed by the corresponding contralateral finger. Our 
results, therefore, argue that ipsi- and contralateral actions ac- 
tivate the same patches or that the activated patches are at 
least spatially correlated (Fig. 3A). 

Additional analyses show that these patterns were not 
caused by overt mirror movements of the contralateral hand. 
Mirror movements should be apparent in slight force in- 
creases in the mirror-symmetric finger that was pressed on 
the other hand. We monitored these by instructing partici- 
pants to keep both hands placed on the keyboard and exert a 
light constant pressure with all 10 fingers. We detected signifi- 
cant contralateral increases (/><0.05, uncorrected) for presses 
of the 4th and 5th digits. However, these increases averaged 
0.011 N for the ring and 0.025 N for the little finger, well 
below 1% of the average force increase in the instructed hand 
(3.46 N). For the other 3 fingers, no significant mirror move- 
ments were observed. However, the cortical activation pat- 
terns distinguished between digits 1 and 3 (average pairwise 
d = 3.55) better than between digits 4 and 5 (pairwise d = 
3.12). We also show that if we remove the influence of force 
changes on the contralateral hand (see Materials and 
Methods), the classification accuracy for the ipsilateral fingers 
across all functional finger ROIs was reduced by <1%. There- 
fore, we conclude that the observed mirror movements were a 
consequence of strong cortical mirror activation. Our results 
clearly argue against the alternative interpretation that the cor- 
tical activation patterns are merely a consequence of sensory 
re-afference from mirrored muscle contractions induced by 
uncrossed cortico-spinal innervations or other spinal 
mechanisms. 

To summarize, Experiment 1 showed that when people 
make individuated finger movements, 2 processes occur in 
ipsilateral cortical motor regions. First, in many areas, the 
BOLD signal is generally suppressed, most likely relating to a 
suppression of synaptic activity (Shmuel et al. 2002, 2006). 
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Secondly, below this suppression, there is a finger-specific 
activation of the same voxels that are activated by the mirror- 
symmetric contralateral finger press. This mirrored represen- 
tation, although weaker, was also found in the premotor area 
that showed increased activity during ipsilateral actions. 



Experiment 2: The Ipsilateral Mirror Representation 
Disappears During Bimanual Actions 

The high correlation between patterns for ipsi- and contralat- 
eral fingers found in Experiment 1 suggests that ipsilateral 
finger presses activate the same patches that are active during 
contralateral finger presses (Fig. 3^4, identical representation). 
However, it may also be true that the representations are inde- 
pendent, but arranged in a spatially correlated fashion (corre- 
lated representations). The limited spatial resolution of fMRI 
would then give the impression of highly similar patterns. 

In Experiment 2, we thought to dissociate these 2 possibili- 
ties by studying how the representations of ipsi- and contral- 
ateral fingers interact during bimanual actions. If ipsilateral 
actions activated the same circuits involved in contralateral 
control, then this would cause problems if one were to 
execute an asymmetric bimanual action. In this situation, we 
therefore predict that the ipsilateral finger representations 
should be suppressed by the ongoing activity related to the 
contralateral hand. If, however, the ipsilateral and contralat- 
eral representations relied on different neuronal circuits, then 
both should remain visible during bimanual actions. 

Participants were instructed to make unimanual or biman- 
ual finger presses. In the unimanual condition, participants 
had to press 1 of 3 the fingers (digit 1, 3, or 5) of the left or 
right hand (Fig. 4A). In the bimanual condition, all 9 possible 
combinations of these fingers were tested (Fig. 4B). We then 
used 3 separate classifiers to identify regions that showed 
finger-specific patterns: 1 for left unimanual actions, 1 for 
right unimanual actions, and 1 for bimanual actions. The 
latter classifier was trained to distinguish between the 9 
unique combinations of bimanual finger presses, independent 
of the fingers involved in the combination. 



A 



Unimanual 



Bimanual 



Figure 4. Methods for Experiment 2. 14) In the unimanual condition, we tested 3 
fingers for each hand. Separate classifiers were used to detect representations of 
contra- and ipsilateral fingers. (6) In the bimanual condition, all 9 combinations of the 
left and right fingers were tested. A single bimanual classifier was trained to 
distinguish between these 9 combinations. By comparing the true bimanual 
combination with the classifier's prediction, we could then determine whether the 
fingers of the contra- and/or ipsilateral hand were decoded correctly. 



By comparing the true bimanual action with the action that 
the classifier predicted, we could then determine how 
strongly the pattern reflected the contra- and/or ipsilateral 
finger. For example, if the true finger combination involved 
both thumbs (cell 1,1, Fig. 4H), then any classifier prediction 
falling into the first column would imply correct contralateral 
classification and any prediction in the first row would imply 
correct ipsilateral classification. Thus, while ipsi- and contral- 
ateral fingers were inherently decoded together, we could 
nevertheless determine the strength of the ipsi- and contralat- 
eral representations during bimanual actions separately. 

For the unimanual condition (Fig. 5A, upper row), we repli- 
cated Experiment 1: large areas of the sensory motor cortex 
encoded the ipsilateral action (Table 3, unimanual). Again, 
these regions were nearly identical to those encoding the con- 
tralateral finger presses (data not shown). 

What would we now expect to see in the bimanual con- 
dition? If independent sets of neurons responded to contra- or 
ipsilateral actions, then the ipsi- and contralateral pattern 
should combine in the bimanual condition. Simulations based 
on the assumption of independent representations would 
combine in an approximately linear fashion (see Supplemen- 
tary Material for details), predicted that we should observe an 
equal decrease in both the contra- and ipsilateral classification 
accuracies (Fig. 5B). 

The data clearly fail to support this prediction. In the func- 
tionally defined finger ROIs of the primary sensory and motor 
cortices (Fig. 5C), the classification accuracy for the contralat- 
eral finger was comparable across unimanual and bimanual 
conditions, all f(6)< 1.763, P> 0.128. In contrast, the ipsilat- 
eral representation disappeared almost completely in the bi- 
manual condition (Fig. 5A, lower row). Compared with the 
unimanual condition, the accuracy for the ipsilateral finger 
was significantly reduced in Ml [f(6) = 4.288, P= 0.005] and 
SI [/(6) = 4.902, P = 0.003]. Thus, the classifier accurately 
decoded the contralateral finger during bimanual actions, but 
performed nearly at chance levels for the ipsilateral finger. 
Thus, the data are clearly at odds with linear superposition of 
patterns. In the additional analysis, we show that the reduction 
in accuracy cannot be explained by signal-dependent increases 
in noise or a nonlinearity between neural activity and the 
BOLD signal (Supplementary Material). 

These findings, therefore, indicate that the strong encoding 
of ipsilateral actions found in the unimanual condition truly 
disappears during bimanual actions. This conclusion is further 
supported by a pattern decomposition analysis (discussed sub- 
sequently). Thus, our results argue against independent rep- 
resentations of contra- and ipsilateral fingers in the primary 
motor cortex. Rather, it seems that if one motor cortex is not 
involved in the control of a contralateral action, ipsilateral 
finger presses lead to the activation of exacdy those circuits 
that would normally be involved in the mirror-symmetric finger 
press. When both hands are functionally engaged, the contral- 
ateral action dominates the local activity pattern. 

A Different Type of Ipsilateral Representation for Bimanual 
Actions 

There were, however, regions from which the classifier could 
decode both the contra- and ipsilateral fingers during biman- 
ual actions. Such activity was present in both hemispheres on 
the boundary between Ml and PM and in the anterior parietal 
lobule (Fig. 5 A, lower row). Although the encoding was 
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Figure 5. Representations of ipsilateral fingers during unimanual and bimanual actions. Ifl) Surface maps of the classification accuracy for the ipsilateral finger (40% accuracy 
threshold, Z = 1) during unimanual (upper row) and bimanual (lower row) finger presses. (6) Predicted accuracies, assuming that contra- and ipsilateral patterns superimpose 
linearly. (C) Observed classification accuracy in informative subregions (see Materials and Methods) of 3 anatomical ROIs for contralateral (red) and ipsilateral (blue) fingers. 
Results are averaged across the 2 hemispheres. Error bars represent across-subject standard error of the mean, (fl) Spatial relationship of areas encoding the contralateral (50% 
threshold, red) and ipsilateral fingers (40% threshold, blue) during bimanual actions. Circles indicate the individual COGs of the functional finger ROI of the precentral and 
postcentral gyri. CS, central sulcus; SFS, superior frontal sulcus. 



Table 3 

Cortical areas that show significant classification accuracy for the ipsilateral fingers during 
unimanual and bimanual actions in Experiment 2 



Location 


Peak 
f-value 


Area 
(mm 2 ) 


P 

(cl.) 


x (mm) 


y (mm) 


z (mm 


Unimanual 














Left M1/S1 


7.11 


1284 


0.000 


-31.43 


-21.27 


44.83 


Right S1 


8.94 


547 


0.001 


44.76 


-26.56 


46.42 


Right M1 


8.71 


388 


0.004 


38.49 


-12.23 


63.13 


Bimanual 














Left PM 


12.81 


561 


0.000 


-27.00 


-16.17 


66.54 


Left SPL 


7.40 


328 


0.003 


-31.58 


-36.12 


56.53 


Left SPL 


10.01 


173 


0.037 


-39.34 


-41.27 


38.66 


Left parietal 


11.20 


216 


0.016 


-60.27 


-28.55 


20.78 


Operculum 














Right PM 


15.82 


1004 


0.000 


30.64 


-15.33 


61.38 


Right SPL 


14.37 


169 


0.024 


28.75 


-59.17 


46.82 



Only clusters that are significantly corrected for multiple tests over the cortical surface are 
shown. At an uncorrected threshold of f(6) > 3.707, P = 0.005, the critical cluster size for 
P < 0.05, corrected, is 159 mm 2 . 



weaker than that found during unimanual actions, it was 
significant in both hemispheres after correcting for multiple 
tests (Table 3, bimanual). 

Our results indicate that this bimanual finger representation 
differed fundamentally from the ipsilateral finger represen- 
tation observed during unimanual actions. At first glance, this 



difference is apparent in the spatial locations of the regions 
that coded for contra- and ipsilateral fingers (Fig. 57)). For bi- 
manual actions, the ipsilateral finger representation was located 
further away from the central sulcus than the contralateral rep- 
resentation. In the anatomically defined precentral ROI, the 
individual COGs for the ipsilateral fingers were more anterior 
than those for the contralateral fingers [left hemisphere: 
7^(2,5) = 44.82, P< 0.0048 and right hemisphere: 7^(2,5) = 48.74, 
P< 0.004). Similarly, in the postcentral gyrus, the ipsilateral COGs 
were located more posterior [left: 7^(2,5) = 19-37, P = 0.027 
and right: 7^(2,5) = 37.13, P= 0.0072]. In contrast, a similar 
spatial analysis for unimanual actions did not yield a signifi- 
cant difference for the precentral gyrus, replicating the results 
of Experiment 1. Finally, a direct comparison of the area en- 
coding ipsilateral fingers during bimanual and unimanual 
actions showed that the COGs differed significantly in the 
right precentral [7^(2,5) = 34.48, P = 0.008] and postcentral 
ROIs [7^(2,5) = 32.75, P= 0.009] and were marginally different 
for the left precentral [7 2 (2,5) = 8.227, P = 0.115] and postcen- 
tral ROIs [7^(2,5) = 7.625, P = 0.128]. These results indicate 
that the mirrored ipsilateral finger representation during un- 
imanual actions is located predominantly in caudal or "new" 
Ml, whereas the ipsilateral finger representation for bimanual 
actions is shifted toward the rostral or "old" Ml (Rathelot and 
Strick 2009) and caudal PM. 
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Encoding of Bimanual Actions Relies on Elements with 
Nonlinear Tuning 

If the identified ipsilateral region is functionally engaged in 
the control of coordinated bimanual movements, we hypoth- 
esize that it should represent bimanual finger presses jointly. 
Consider the example of playing a tune on the piano. Imagine 
that you need to accentuate a combination of notes played 
jointly with the left thumb and the right middle finger 
(Fig. 6A,B, cell A) and another combination of notes played 
by the left middle finger and right little finger (cell B). All 
other combinations of the same fingers (cells C and D) should 
not receive the same stress. If the motor system had only 
neural units with tuning functions reflecting a linear combi- 
nation of the left- and right-hand actions, such a task could 
not be learned. For example, any change to the output of a 
unit that is mostly activated during bimanual combination A 
would generalize to bimanual actions C and D (Fig. 6A). To 
produce different amounts of force for arbitrary combinations 
of bimanual movements, the motor system, therefore, needs 
neural circuits that show nonlinear tuning for bimanual 
actions (Fig. 6B; Yokoi et al. 2011). One example would be 
patches of cortex that responded preferentially to a single 
specific bimanual combination. However, any sufficient set of 
arbitrary nonlinear tuning functions would allow the nervous 
system to learn arbitrary functions of 2 variables (Zipser and 
Andersen 1988; Pouget and Sejnowski 1997). 

How can we determine whether the activity patterns 
related to ipsi- and contralateral finger movements combine 
linearly or nonlinearly? To illustrate the analysis, we visualized 
the tuning properties of voxels for uni- and bimanual actions 



in the functional bimanual ROI of the precentral regions (see 
Materials and Methods and Fig. 60- We split these voxels into 
9 groups, based on the bimanual condition for which a voxel 
showed the highest activity (black cross). Each 3x3 matrix 
now shows the average activity of these 9 voxel groups in the 
unimanual and bimanual conditions. 

Consistent tuning for finger presses for 1 hand can be deter- 
mined by averaging the bimanual tuning functions across the 
fingers of the respective other hand (Fig. 6C, arrows). A consist- 
ent representation would be evident in differences between 
these averaged patterns. We can quantify the strength of each of 
these main effects by estimating the variance of the correspond- 
ing pattern component (see Materials and Methods, Diedrich- 
sen et al. 2011), a measure analogous to the sum of squares in a 
traditional 2-factorial univariate analysis of variance (ANO\A). 

For the main effect for the contralateral fingers, the var- 
iance estimates were relatively large and equal across uniman- 
ual and bimanual conditions (Fig. 7A), indicating strong and 
consistent encoding of this variable. This consistent tuning 
can even be seen in the tuning functions when averaging 
within rows (Fig. 6C). From this figure, it is also apparent that 
the consistent bimanual tuning was very similar to the tuning 
during contralateral unimanual actions. Indeed, the corre- 
lation between the informative part of the unimanual and bi- 
manual patterns was nearly one for both the pre- and the 
postcentral ROIs (Fig. 70- Thus, the tuning for the contralat- 
eral finger in the bimanual condition can be nearly perfectly 
predicted by the tuning in the unimanual condition. 

In contrast, the variance estimate for the ipsilateral fingers 
in the bimanual condition was much lower than that in the 



E 
B 

CD 

"c 

o 
O 



B 



o 
O 



Thumb Middle Little 





A 


C 




D 


B 









Ipsilateral Finger 



Thumb Middle Little 



Ipsilateral Finger 



H 



Contralateral 
Unimanual 



Ipsilateral Finger 
Thumb Middle Little 





X 


1 















X 

















X 



□ 



Averaged 
bimanual 













X 



Ipsilateral 
Unimanual 



0 CO 

1 & 

CO 

La 




Figure 6. Nonlinear tuning of voxels for bimanual actions. Ifi] Tuning function of a hypothetical neural unit for the 9 task conditions of a bimanual task. The activity of this unit 
(indicated by the gray shading) is determined by a linear combination of a tuning function for the ipsi- and contralateral fingers. Any change in the units output would influence 
task condition A mostly, but would generalize to conditions C and D. A system that has only linear units could, therefore, not learn a task in which a different output has to be 
produced for combinations A and B than for bimanual finger combinations C and D. (6) Instead, the control of such a task requires cortical circuits with nonlinear combinations of 
contra- and ipsilateral actions. (C) Average tuning functions of the voxels in the functional bimanual ROI in precentral gyrus, averaged across hemispheres and participants. Each 
3x3 matrix indicates the activity of 9 groups of voxels, which were selected based on the bimanual combination for which they are most highly activated (black cross). The 
activity in the other conditions can then be averaged across the contralateral or ipsilateral finger to reveal the presence of consistent tuning across the bimanual actions. For the 
contralateral finger, this tuning is highly similar to the one observed for unimanual actions. For the ipsilateral finger, no tuning is apparent. Nonlinear tuning would be apparent as 
an interaction effect in this 2-factorial design. 
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Figure 7. Pattern decomposition shows clear evidence for nonlinear bimanual tuning of voxels in the functionally defined bimanual R0I in pre- and postcentral gyri. (4) For the 
bimanual patterns, the variance estimate for the contralateral component is relatively strong and equivalent for uni- and bimanual movements. (fl) The variance of the ipsilateral 
component effect is reduced for the bimanual movement compared with unimanual. However, a substantial interaction effect between ipsi- and contralateral fingers (white bar) 
is observed. (C) For contralateral fingers (red), there is a high correlation between the unimanual and bimanual pattern components of the same finger. For ipsilateral finger 
presses (blue), there is no systematic relationship. Box plots extend from the 25th to the 75th percentile. Whiskers indicate the full range of the data, with circle indicating data 
points that are further away from the median than 1.5 the times the box length (intraquartile range). (D) The classification accuracy for the ipsilateral finger during bimanual 
actions correlates with the size of the interaction effect. Values for the bimanual area within the left and right precentral and postcentral ROIs are shown for each participant, 
(f) Classification accuracy does not correlate with the size of a pattern component related to the ipsilateral main effect. Error bars indicate between-participant SE. 



unimanual condition (Fig. IS). This reflects the observation 
that the voxels showed no consistent tuning for the ipsilateral 
fingers when averaging the bimanual activity along the 
columns (Fig. 60- It also confirms the results of the classifi- 
cation analysis (Fig. 5^4), again showing that the consistent 
tuning for ipsilateral actions disappears in the bimanual 
context. 

Importantly, neuronal circuits that show nonlinear tuning 
for ipsi- and contralateral fingers would become evident in an 
interaction effect between the 2 main factors. Indeed, a sub- 
stantial part of the pattern variance in the bimanual condition 
was explained by the nonlinear interaction term (Fig. IB, 
white bar). This finding indicates that the ipsilateral action 
modulated the activity of voxels in a way that depended non- 
linearly on the contralateral action. Across subjects and pre- 
and postcentral regions, the interaction effect predicted the 
classification accuracy for ipsilateral finger during bimanual 
actions ir= 0.837, P< 0.001, Fig. ID), whereas the estimated 
strength of the ipsilateral main effect did not (r=— 0.25, 



P= 0.193, Fig. IE). Thus, we can conclude that the observed 
classification accuracy for the ipsilateral finger during biman- 
ual actions depended on neural circuits with nonlinear tuning 
for ipsi- and contralateral actions. 

What is the source of this nonlinear encoding? First, we 
considered the possibility that the neural areas involved in 
producing bimanual actions were more activated during 
asymmetric actions (trials with different fingers) than during 
symmetric actions (trials with the same fingers). Such an 
effect would indeed lead to an interaction between the 
contra- and ipsilateral fingers. Many prior imaging studies 
have found more activity during asymmetric than during sym- 
metric movements in the SMA, PM, and the SPL (Debaere 
et al. 2001; Ullen et al. 2003; Wenderoth et al. 2004, 2005; 
Diedrichsen et al. 2006). Consistent with these studies, we 
found areas in the superior frontal sulcus and along the IPS 
that were more activated during asymmetric actions (Fig. 8, 
green). This effect, however, was spatially completely separ- 
ate from areas that encoded the bimanual action (Fig. 8, 
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Figure 8. Areas that show an effect of bimanual congruency (green) and bimanual 
finger encoding (blue) do not overlap. Green areas are activated more during 
asymmetric than during symmetric movements (threshold: 0.07% signal change), and 
blue areas show above-chance classification accuracy for the ipsilateral finger during 
bimanual actions (40% threshold). An effect of congruency was found in the depth of 
the IPS and superior frontal sulcus (SFS), whereas the encoding of bilateral finger 
movements is more closely located to the central sulcus (CS). 

blue). Furthermore, in the bimanual (blue) regions, no differ- 
ence between symmetric and asymmetric activity patterns 
could be found; the classifier could distinguish equally well 
between 2 patterns associated with asymmetric trials, as 
between symmetric and asymmetric patterns. Thus, the non- 
linear encoding of bimanual finger combinations and the 
encoding of the congruency of bimanual actions were 
independent. 

Secondly, we tested the idea that the nonlinear tuning may 
not reflect direct encoding of the ipsilateral action, but instead 
reflects the indirect influence of small, but systematic, behav- 
ioral changes in the contralateral hand. Indeed, in a 2-factorial 
ANOVA with the maximal force as the dependent variable and 
the ipsi- and contralateral fingers as the 2 independent 
factors, we observed small but significant interaction effects 
in 5 out of 14 hands, across 3 of the 7 participants. However, 
by regressing these contralateral force changes out of the 
activity patterns before classification (see Materials and 
Methods), we could show that this information contributed 
only minimally to the encoding of the ipsilateral finger. After 
correction, the classification accuracy changed from 43% to 
41%, a nonsignificant difference [f(6) = 1.786, P= 0.124]. Even 
after the correction, the areas still showed significant encod- 
ing of the ipsilateral finger presses [f(6) = 4.894, P = 0.001]. 

Instead, we argue that the nonlinear encoding of the bi- 
manual finger representation reflects neuronal elements that 
are used to control bimanual actions. To be useful for control, 
this population of neural circuits should code for any possible 
combination of movements of the 2 hands. In other words, 
the tuning functions of the cortical patches should evenly 
span the space of possible actions (Pouget and Sejnowski 
1997). This implies that there should be a different activation 
pattern for each bimanual action and that each pair of actions 
should be distinguished by the activity of a comparable 
number of neuronal patches or voxels. Thus, when going 
from one bimanual action to another, a comparable number 
of voxels should change their activation. Therefore, we 
predict that the activity patterns associated with different bi- 
manual actions should be equally dissimilar to each other. To 
test this, we determined the 9 possible pairwise correlations 
between patterns that shared the same contralateral finger 
and submitted these to a 1-factorial repeated-measures 



ANOVA. The analysis showed that the 9 pairs were roughly 
equidistant (both i 7 8 4 8 <1.35, P>0.24, for pre- and postcen- 
tral ROIs). Thus, the tuning properties of these voxels uni- 
formly spanned the whole space of tested bimanual 
combinations. 

To summarize, we identified a region in the transitional zone 
between Ml and PM and in the posterior somatosensory cortex 
that encoded bimanual finger movements in a way that would 
be maximally useful for the fine control of bimanual actions. 

Discussion 

During unimanual ipsilateral actions, the BOLD signal in the 
hand area of the primary motor cortex decreases consistently, 
indicating reduced synaptic activity (Talelli, Ewas et al. 2008; 
Talelli, Waddingham et al. 2008). Somewhat more anterior, 
on the boundary of PM, increases in activity are regularly ob- 
served (Rao et al. 1993; Boecker et al. 1994; Kim et al. 1994; 
Kawashima et al. 1998; Cramer et al. 1999; Hanakawa et al. 
2005; Horenstein et al. 2009). The question that has hitherto 
not been answered is whether these decreases and increases 
in mean activation during ipsilateral actions indicate finger- 
specific patterns or just reflect nonspecific tonic signal 
changes. 

Using multivariate analysis, we demonstrate that primary 
motor and sensory cortices represent ipsilateral finger move- 
ments and do so in fundamentally different ways, depending 
on whether an action is uni- or bimanual. During unimanual 
actions, we observed strong finger-specific modulation of the 
ipsilateral sensory motor cortex in an area that overlapped 
greatly with the area that encoded the contralateral action. 
More importantly, the ipsilateral finger-specific pattern exactly 
matched the pattern elicited by finger presses of the equival- 
ent contralateral finger and vanished during bimanual 
presses. A second representation on the Ml/PM boundary 
and in posterior SI showed nonlinear encoding of bimanual 
actions. All results could be clearly observed in each of the 
individual participants, which led to statistical significance at 
the group level, despite the relatively low number of 
participants. 

The representation for ipsilateral unimanual movements 
was strongest in areas that showed a global suppression of 
the BOLD signal due to the ipsilateral movement, but also ex- 
tended to regions that were activated during ipsilateral finger 
presses. Although it is possible that the ipsilateral pattern 
arises from "less deactivation" in mirror-symmetric circuits, 
we consider it more likely that 2 separate inter-hemispheric 
processes are involved in producing this result. The first 
process automatically "activates" the circuits encoding mirror- 
symmetric movements of the contralateral hand. Support for 
the idea that such a mechanism exists comes from the well- 
known phenomenon of mirror movements during unimanual 
actions (Duque and Ivry 2009; Sehm et al. 2010; Verstynen 
and Ivry 2011). However, we show here that the patterns 
related to the ipsilateral finger movement cannot be solely the 
sensory consequence of such overt mirror movements. 
Although we observed some signs of mirror activation in the 
contralateral hand, the changes were neither strong nor con- 
sistent enough to explain the observed activation patterns. 

The second process during ipsilateral actions globally "sup- 
presses" activity, most likely to reduce the chance of overt 
mirror movements. Recent studies have shown that the 
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suppression of the ipsilateral BOLD signal is correlated with 
the strength of inter-hemispheric inhibition, as probed by 
dual-pulse TMS (Talelli, Ewas et al. 2008), making a neural 
origin of this suppression likely (but see Devor et al. 2008). 
Specifically, it correlates with inter-hemispheric inhibition at a 
40 ms, rather than a 10 ms, interstimulus interval, suggesting 
the involvement of polysynaptic connections through pre- 
motor areas, rather than direct Ml-to-Ml inhibition. Uniman- 
ual actions are also associated with a suppression of the 
motor-evoked potential elicited by a TMS pulse to ipsilateral 
Ml (Duque and Ivry 2009). A recent study showed that this 
suppression is weakest if the ipsilateral movement is mirror- 
symmetric to the movement evoked by the TMS pulse (Yedi- 
menko and Perez 2010), a finding consistent with the idea of 
a superposition of action-specific activation and global sup- 
pression. This 2-process model can also account for the fact 
that the BOLD suppression observed in younger individuals 
turns into overall activation in older adults (Talelli, Ewas et al. 
2008). 

During bimanual actions, the strong, mirrored patterns ob- 
served during unimanual actions disappeared completely. 
One possible mechanism explaining this dramatic switch is 
the gating of inputs through features of the local circuitry 
(Fries 2009). When the motor cortex is not involved in an 
action of the contralateral hand, callosal inputs from the other 
hemispheres can activate the local recurrent network, and the 
BOLD signal would reflect the ipsilateral action. In contrast, 
when the local circuitry receives input from a higher-level 
area to execute a contralateral action, the same presynaptic 
input may not influence the recurrent activity and the effect 
on the observed BOLD signal would be minimal. Previous 
studies have reported that one can decode the direction of 
ipsilateral arm movements from cortical surface potentials 
(Ganguly et al. 2009). Our results suggest that this represen- 
tation should disappear as soon as the motor cortex becomes 
functionally engaged during a bimanual task. 

The mirrored nature of the ipsilateral representation and its 
disappearance during bimanual movements suggest that it 
does not play an active role in the control of movement, but 
rather constitutes a passive overflow of activity that ultimately 
needs to be suppressed to avoid mirror movements. Whether 
this mirroring serves other functions, for example, the transfer 
of motor learning between hemispheres, is an open question 
that cannot be answered by observational methods such as 
fMRI alone. It is also possible that the ipsilateral hemisphere 
plays a more prominent role in the production of complex 
finger movements. Patients with unilateral motor cortical 
lesions show no ipsilesional impairment of maximal grip 
force, but do exhibit some ipsilesional deficits in fine finger 
control (Noskin et al. 2008). Furthermore, in healthy individ- 
uals, skilled sequence production is impaired after repetitive 
TMS stimulation of the ipsilateral motor cortex (Chen et al. 
1997). During such complex movements, a region on the 
boundary to PM is commonly activated (Catalan et al. 1998; 
Cramer et al. 1999; Hanakawa et al. 2005; Verstynen et al. 
2005; Horenstein et al. 2009; Verstynen and Ivry 2011). For 
the simple unimanual finger presses studied here, this region 
only showed weak activation and weak representation of the 
ipsilateral finger. While the contra- and ipsilateral patterns 
were also correlated in this region, this correlation was 
slightly lower than that in other regions. Thus, it is possible 
that there is an independent ipsilateral finger representation 



in this region, which would become more clearly visible for 
more complex actions. The multivariate techniques developed 
here will allow us to test this hypothesis in future experiments 
with complex sequential finger movements. 

For bimanual actions, we found clear evidence for a second 
type of ipsilateral finger representation in premotor and parie- 
tal cortices. The center of the bimanual representation was 
located slightly more anterior in the precentral gyrus and 
more posterior in the postcentral gyrus, relative to the unim- 
anual representation (Donchin et al. 1998). 

The localization of the bimanual representation in premotor 
and parietal cortices appears to contradict the extensive litera- 
ture that hypothesizes a special role for the SMA in bimanual 
behaviors (Brinkman 1984; but see Wiesendanger et al. 1994; 
Kazennikov et al. 1998). We found both ipsilateral and contral- 
ateral representations for unimanual finger presses in the SMA 
(Table 2), but only a rather weak bimanual representation 
(Fig. 5^4), which was not significant after correcting for mul- 
tiple comparisons. One explanation for this lack of finding is 
that the finger representations in the SMA may be spatially less 
strongly clustered than those in premotor and parietal cortices. 
Combined with the restricted spatial resolution of the fMRI, 
this would lead to poorer classification accuracy. 

It needs to be also kept in mind that one of the main argu- 
ments for a special role of the SMA in bimanual coordination 
comes from fMRI studies that reported increased activation 
for asymmetric bimanual movements compared with the 
easier symmetric bimanual movements (e.g. Jancke et al. 
2000; Debaere et al. 2001; Ullen et al. 2003). These studies 
are somewhat problematic as the SMA also shows increased 
activity during asynergistic compared with easier synergistic 
"unimanual" hand movements (Ehrsson et al. 2002). Further- 
more, single-cell recording studies, in which the tuning prop- 
erties of cells during bimanual movements were measured, 
found little evidence for a special role of the SMA. Bimanual 
tuning was just as strong as in Ml (Donchin et al. 1998, 2001, 
2002; Kermadi et al. 1998), the dorsal premotor, and parietal 
cortex (Kermadi et al. 2000). Our representational fMRI analy- 
sis confirms these results, arguing that bimanual movements 
are encoded not only in the SMA, but also prominently in 
dorsal premotor and parietal cortices. 

The ipsilateral bimanual patterns in these regions were 
clearly different from the ipsilateral unimanual patterns, as they 
did not correlate with each other. Rather, the activity of each 
voxel was determined by a nonlinear function of the contra- 
and ipsilateral fingers: the response of each voxel to a particu- 
lar ipsilateral finger heavily depended on the accompanying 
contralateral finger. Similar nonlinear encoding has been ob- 
served on the single neuron level for bimanual arm movements 
(Donchin et al. 1998). As in our study, the ipsilateral tuning of 
neurons during bimanual actions showed little relation to the 
tuning of the same neurons during unimanual actions. 

This nonlinear encoding was not related to the difference 
between symmetric and asymmetric bimanual actions. While 
we found areas that were more highly activated during asym- 
metric actions (Fig. 8, green areas), these were spatially separ- 
ate from areas that encoded individual bimanual finger 
presses (Fig. 8, blue areas). Instead, the nonlinear encoding 
of bimanual actions was caused by individual voxels being ac- 
tivated for particular combinations of bimanual finger 
presses. Such nonlinear basis functions would be useful for 
learning movement representations, in which commands to 



1 374 Two Distinct Ipsilateral Finger Representations 



Diedrichsen et al. 



the contralateral hand depend nonlinearly on the context pro- 
vided by the intended ipsilateral action. Consistent with this 
proposed function, our analysis shows that the basis functions 
spanned the space of possible actions evenly — a prerequisite 
for successful learning (Pouget and Sejnowski 1997). 

Recent studies of motor learning indeed suggest that bi- 
manual movements are learned using nonlinear basis func- 
tions. For example, the motor system is very slow to adapt to 
force fields that push the hand either to the left or to the right 
on a trial-by-trial basis, even if these switches are fully pre- 
dictable (Wainscott et al. 2005). However, if participants 
execute bimanual movements, and if each force direction is 
associated with a unique movement direction of the other 
hand, such perturbations can be learned much more quickly 
(Nozaki et al. 2006; Nozaki and Scott 2009; Howard et al. 
2010). In the premotor and anterior parietal areas described 
here, slightly different neuronal populations would be 
engaged in each bimanual movement combination. Control 
strategies learned by this population would only weakly gen- 
eralize to other bimanual combinations, even if these share 
the same contralateral or ipsilateral movement. Indeed, recent 
results indicate that the pattern of generalization to other bi- 
manual movement combinations is consistent with this type 
of nonlinear gain-field encoding of left- and right-hand 
actions (Yokoi et al. 2011). The ipsilateral encoding found in 
the bimanual areas would, therefore, not have a direct role in 
the control of the ipsilateral movement, but rather supply the 
contralateral controller with the necessary information about 
the movement state of the other hand, thereby enabling coor- 
dinated bimanual actions (Diedrichsen et al. 2010). 

Conclusion 

Using an information-based definition of representation, we 
have demonstrated the existence of an anatomically localized 
representation of ipsilateral actions. Moving beyond nonspecific 
descriptions of increases and decreases in the BOLD signal, we 
show that the nature of this ipsilateral cortical representation of 
movement changes with the behavioral context. 
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